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Abstract 



The Shannon sampling theorem for bandlimited wide sense stationary random processes was 
established in 1957, which and its extensions to various random processes have been widely studied 
since then. However, truncation of the Shannon series suffers the drawback of slow convergence. 
ry i Specifically, it is well-known that the mean-square approximation error of the truncated series at 

^ , n points sampled at the exact Nyquist rate is of the order 0(-jS=). We consider the reconstruction 

of bandlimited random processes from finite oversampling points, namely, the distance between 
consecutive points is smaller than the Nyquist sampling rate. The optimal deterministic linear 
reconstruction method and the associated intrinsic approximation error are studied. It is found that 
one can achieve exponentially-decaying (but not faster) approximation errors from oversampling. 
£SJ ' Two practical reconstruction methods with exponential approximation ability are also presented. 

^ . Keywords: bandlimited random processes, oversampling, the intrinsic approximation error, ex- 

ponential decayness 
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g ■ 1 Introduction 

The purpose of this paper is to establish exponentially approximating reconstruction methods from 
finite oversampling for bandlimited wide sense stationary random processes. The motivation comes 
from the slow convergence of the truncated Shannon series for random processes and the recent progress 
in the study of oversampling for bandlimited deterministic signals. 

The foundational Shannon sampling theorem [19\ [22] states that every bandlimited deterministic 
signal can be completely recovered from its function values on sampling points equally-spaced at the 
exact Nyquist rate. We introduce the details for later discussion. Let B$, 5 > 0, denote the Paley- 
Wiener space of functions / G C(R) n L 2 (M) with Fourier transform supported on [—5, $]. The Fourier 
transform is defined for / £ by 
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and for tempered distribution by a duality principle [7]. The Nyquist rate for the bandwidth 5 is tt/S. 
For simplicity, we discuss B n whose Nyquist rate is 1. The Shannon sampling formula is 

/(*) = E sinc (* " i)> teR, f€B v , (1.1) 

where the series converges absolutely and uniformly on R. Here, sinc denotes the sinc function 

, . shi7ri m 
sine i := , tel. 

In practice, only finite and localized sampling data are available. For instance, to reconstruct the 
values of / G B n on [0,1], one may only have at hand the sample data f(J n )- Here, J n := {j € 
Z : —n + 1 < j < n}. In this case, it has long been observed that directly truncating the Shannon 
series (jl.ip suffers the drawback of slow convergence (HEBE]. Specifically, there exist some positive 
constants C\ , C2 such that 



C, n ".f\\v*p) < 



sup[ f(t) - E /(*) sine (t-j) :t€ [0, 1] j < 



c 2 



n 



The Shannon sampling theorem and its extensions have been established for bandlimited wide 
sense stationary random processes [2|[3|l5|[9|HH[T8]. A random process X = X(t, uj) on an underlying 
probability space (O, P) is said to be weak sense stationary (w.s.s.) if X(t,-) £ L 2 (Q,dP(to)) for 
each t G K, that is, 



\\X{tr)\\v(n,dP(u,))-'=[J\X(t,u)rdP(u)\ < +00, teR, (1.2) 
and its autocorrelation function 

R x (t,r)= / X(t,u)X(T,u)dP(u), t,r£R (1.3) 
depends ont-r only. It implies that 

R X (t,T)=R X (t-T,0). 

We often abbreviate i?x(£, 0) as Rx(t). A w.s.s. random process X(t, oS) is said to be bandlimited if 
Rx belongs to B$ for some 5 > 0. 

The Shannon sampling theorem for random processes, first proved in [2], states that for a w.s.s 
random process X(t,u)) with i?x G B^, 

sine (t — j), tel. (1.4) 

jez 

The above equation holds in the sense 

2 

= 0, i G R, (1.5) 



lim £J 

n— >oo 



X(t,w) - £ A(j» sinc (t-j) 

j6Jn 



where the expectation is taken with respect to the probability measure P. When using finite sampling 
points at the exact Nyquist rate, truncating the Shannon series (|1.4p also results in a very slow 
reconstruction. The expectation in (I1.5P is of the order 0{-^=) as well, [3]. 
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For bandlimited deterministic signals, dramatic improvement of the approximation order appears 
suddenly if oversampling data are used. For simplicity, we let f £ B$ with 5 < n. Thus, integer 
sampling points are equally-spaced by 1 < ir/8 and hence constitute oversampling points. Modified 
Shannon series of the form 

f (j) sine (t-j)^(t- j) 
were proposed to reconstruct f(t),t£ [0, 1] from its oversampling data f(J n )- By setting 

6(t) := sinc m (^^t), ieR (1.6) 
7rm 

and optimizing about the parameter m, a reconstruction error bounded by 

C , 7r — 5 . ^ e ,., 
■exp( n), n> (1.7) 



n{TT — o) e 7T 

was established in [TO]. By choosing to be a Gaussian function with an optimal variance, references 
[TOl [TO] obtained an approximation error bounded by 



. n it -5 8vr 
Gil F ex Pl 7> — n )' n — 



^ 2 h - (vr-<5) 3 ' 



By optimizing the weight function <f>, it was proved in [14] that one can achieve the following upper 
bound for reconstruction errors 

C ( *- § ^ 
— =exp( n), n € N. 

Jn 2 



The optimal weight was later found to be a spline function in the Ph.D. thesis [23]. 

We believe that oversampling should always lead to exponential approximation for bandlimited 
signals. This paper aims to reveal this phenomenon for bandlimited random processes. We shall apply 
the modified Shannon series approach 

X sine (t-j)(t>(t-j). (1.8) 

However, directly applying the methods in [101 114} IT5] may not yield satisfactory error estimates. For 
example, we shall see in Section 3 that by directly using the result in [TO], one will get an approximation 
error bounded by 

/ Inn 7T-5 

C\ —, rrexp( — n). 

y n{TT — 0) 2e 

Compared to (|1.7p . the dominating exponential part degenerates. To overcome this, careful analysis 
will be carried out in Section 3 to show that using the optimal spline weight function given in [23j 
leads to an approximation error bounded by 



121 3/4 r— lnn+1 1/4 , tt-S s 

e ci/4 V2 + 7r - 5( ) 1/4 exp ( n) . 

200 y 2n ' ^ y 2 ' 

Before estimating the approximation error of the above two explicit and practical approximation 
methods, we shall discuss in Section 2 the optimal deterministic linear method for the reconstruction of 
a bandlimited w.s.s. random process from oversampling. We will see that the optimal linear method is 
impractical as it requires the solving of a highly ill-posed linear system. Our main purpose is to estimate 
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the associated intrinsic approximation error, providing us guidelines and expectation in constructing 
practical reconstruction methods. This question is closely related to the optimal reconstruction in a 
reproducing kernel Hilbert space. Thanks to existing results on reproducing kernels, an upper and 
lower bound estimates will be established. In particular, the lower bound estimate reveals that there 
does not exist a deterministic linear reconstruction method with an approximation error tending to 
zero faster than exponential decayness. 

2 Optimal Linear Reconstruction and Intrinsic Errors 

In this section, we consider the best possible linear method of reconstructing a w.s.s. random signal 
bandlimited to [—5, 5} with 5 < ir from its values on finite integer points. We shall find that this is 
closely related to the question of optimal reconstruction of functions in a reproducing kernel Hilbert 
space from its finite samples. For this reason, we first introduce the notion of reproducing kernels and 
reproducing kernel Hilbert spaces [l] . 

A function K : R x R — > C is said to be positive- definite if for all finite distinct points T := {tj : 
1 < J ' < n} C R, the n x n matrix 

K[T}:= [K{t j: t k ):l<j,k<n] 

is hermitian and positive semi-definite. A positive-definite function K on R x R corresponds uniquely 
to a reproducing kernel Hilbert space denoted as 7~Lk such that K(t, •) £ Hk for all i 6 R and 

f(t) = (/, K(t, -)) Uk for all feH K BJxdte R, (2.1) 

where (•, •) denotes the inner product on %k- By virtue of the above equation, K is also called the 
reproducing kernel oirix- Reproducing kernels are widely applicable to machine learning [17] . Besides 
positive-definiteness, another characterization [6] of a reproducing kernel K is the existence of a feature 
map $ from R to some Hilbert space W such that 

K(t,r) = (*(t),*(r)) W) i, t £ R. 

A typical class of reproducing kernel Hilbert spaces is the Paley- Wiener spaces B$ of bandlimited 
functions. With the inner product 



(f,9)Bs (/ 5 ff)i2(R) : = / f(x)g(x)dx, 

Jr 

Bs is a reproducing kernel Hilbert space with the reproducing kernel 

K 5 (x,y) := ™*( X -V) x, y G R. (2.2) 
vr(x - y) 

Note that K n = sine . The Shannon sampling theorem can be proved by noticing that 

{ sine (• - j) : j £ Z} 

is an orthonormal basis for B^. This basis together with the reproducing property f)2. 1 [) yields the 
following useful identity 

E i /(?) i 2 = ii/i&cr). feB - (2 - 3) 
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Turning to the random case, we observe for a w.s.s. random process X(t,u) that Rx is a repro- 
ducing kernel onlxf because it has the feature map <3?(t) := X(t, u) G L 2 (0, dPito)). Furthermore, 
it is translation-invariant in the sense that 

Rx(t + s,r + s) = R x (t,T), sei 

All continuous translation-invariant reproducing kernels K on M x M are characterized by the Bochner 
theorem [3] as 

K{t,r)= [ e-^-^dnit), *,r€M, 

where /j is a finite positive Borel measure on R. Since we are dealing with bandlimited random 
processes for which Rx G Bg, there holds 

fl* (t, r) = J e t(t_T) * p(£R> i,r£K (2.4) 

for some nonnegative function p G L 2 ([—5, 5]). We assume throughout the section that ||p||i2(r_ ggr\ > 
to avoid the trivial case. 

For a general continuous translation-invariant reproducing kernel K on K x R, the optimal method 
of reconstructing functions / in the unit ball of %k from their samples f{J n ) on J n have been 
understood in [14]. To introduce the result, we denote for a Hilbert space % by U(H) := {f £ H : 
\\f\\~H < 1} its closed unit ball, and by C Jn the set of all the functions on J n . The purpose is to 
reconstruct the function values of / G %x on [0,1] from its samples f\j n . The maximum norm is 
engaged to measure the reconstruction error. Thus, a candidate reconstruction operator A should 
map f\j n to a function in L°°([0, 1]). The approximation error of A is measured by 

£ n (A,K) :=sup{[|/-^(/| Jn )|Uoo ([0) i ]) :feU(H K )}. 

It is well-known [12\ [T3] that the optimal reconstruction operator is by the minimal norm interpolation 
whose approximation error attains the following intrinsic approximation error 

£ n (K) := mf{£ n (A,K) : among all mappings A : C Jn -»• L°°([0, 1])}. 

The intrinsic approximation error is characterized in |14| as 

£ n (K) = sup{||/|| i oo ([0)1]) : / G U(H K ), f(Jn) = 0}. (2.5) 

We consider in this section the optimal deterministic linear method of reconstructing a bandlimited 
random process X(t,u) on t G [0,1] from its samples X(j, (J), j G J n . Specifically, we wish to find 
coefficient functions Cj's on [0, 1] that minimize the quantity 

IW,0 - E c i( f )^0'.-)IU»(n,dP(a,)) (2-6) 

for each t G (0, 1). The associated intrinsic approximation error is measured by 

sup{||X(i,-) - Cj(t)X(j,-)\\L*(n,dP(u>)) ■ t G (0,1)}- 

We first make a simple observation about the optimal coefficients and the above intrinsic error. Let 
V be a normed vector space, xq G V and A C V. We shall denote by span A the linear subspace 
spanned by ^4, and denote by 

dist v{xo, span A) 

the distance of xq G V to span ^4 in V. 
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Proposition 2.1 The optimal coefficient functions c = (cj : j G J n ) minimize \2. 6\) is given by 

c(t) = j) : J G Jn)(^[^n]) _1 , * £ (0, 1) (2.7) 

and the intrinsic error has the form 

S up{\\X(t, Cj(t)X(j, OHl^pM) :<e(o. i)} = £n(Rx). (2.8) 

Proof: The minimum of the quantity (|2,6p is the distance from X (t, •) to the linear space spanned by 
•), j G J n in the Hilbert space L 2 (Q,dP(u})). By the characterization of best approximation in 
HUbert spaces, the optimal coefficients c,'s are hence determined by the orthogonality conditions 

(x(t,-)- cj(t)x(j,-),x(k,-)) L 2 {n4P{oj)) = 0, keJ n . 

By (|1.3p . we reach the linear system of equations 

cRx[Jn] = (Rx(tJ) :j G J n ). 

To get (|2.7p , it remains to point out that Rx(J n ) is nonsingular. We confirm this by showing that it 
is strictly positive-definite. Assume there are coefficients a.j G C, j G J n such that 

a j^kRx(j,k) = 0. 



It follows by that 



2 a - ie 
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p(0<% = o. 



Thus, the holomorphic function 

<p( z ) ■= Y a je - ijz , z G C 

must vanish on the support of p, which is of positive Lebesgue measure. As a consequence, (p vanishes 
everywhere on C, forcing ay = for each j G J n . 

By choosing the optimal coefficients (|2.7p . we compute for each t G (0, 1) 



\\X(t r )-Y,<i(t)XUr)\\v(ti4P(, u )) = (Rx(0) - (R x (t,j) : j e J n )(R x [Jn}rHRx(j,t) : j e J n fY 

One observes that this is also equal to the distance dist^ (Rx(t,-), span {Rx(j, •) : j G Jn})- To 
complete the proof, it remains to show that it equals 

su V {\f(t)\:feU(H Rx ), f(Jn) = 0}. 
Let / G U(H Rx ) with f(J n ) = 0, j G J n . By (EH), 

(f,Rx(j,-))H Rx =fU)=o, jeJ n . 
Therefore, for arbitrary coefficients ay G C, j G J n , there holds 

f(t) = {f,Rx(t r )) HRx =(f,R x (t,-)- £aA(j>K. 
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By the Cauchy-Schwartz inequality, we get 

\f(t)\<\\f\\n Rx Rx(t,.)-J2<*jRxVr) 



< 



H 



Since this is true for arbitrary coefficients ay's, we have 

sup{|/(t)| : / € U(H Rx ), f(J n ) = 0} < dist nRx (R x (t,-), span {R x (j, •) : j G J n }). 
On the other hand, letting 

Rx{t,-)-Y,^j n cj{t)Rx{j,-) 



f = - 

shows that the equality holds. The proof is complete. 



□ 



We remark that although the optimal linear reconstruction algorithm is given in the above propo- 
sition, it is numerically intractable as the condition number of the kernel matrix R x [J n ] typically 
increases to infinity at an astonishing rate as n increases. The following table exhibits such a phe- 
nomenon for the reproducing kernel Kg defined by (|2.2p . 



Table 3.1 The condition number of K$[J n ]. 





n = 1 


n = 3 


n = 5 


n = 7 


n = 9 


5 = 


4 


1.86 


15.5 


248 


4.98 x 10 3 


1.08 x 10 5 


5 = 


7T 

2 


4.50 


2.19 x 10 3 


1.84 x 10 6 


1.75 x 10 9 


1.76 x 10 12 


5 = 


7T 

3 


10.6 


2.51 x 10 5 


7.06 x 10 9 


2.23 x 10 14 


5.13 x 10 16 



Our purpose for this section is to estimate the intrinsic error £ n (Rx) in order to give guidelines 
in constructing deterministic linear reconstruction methods. Two practical reconstruction algorithms 
with exponentially decaying approximation error will be given in the next section. 

To estimate £ n (Rx), we shall need two lemmas. The first one presents the lower and upper bound 
estimates for £ n (Ks) established in [14]. 

Lemma 2.2 fjffi It holds for all 5 < n and n G N that 

2d 



lleV3^2n + 1 V 4 



< S n (K s ) < v^ + vr-S^^exp 

V27T V n 



7T 



-n 



The next lemma is about the inclusion relation of the reproducing kernel Hilbert spaces of translation- 
invariant reproducing kernels. 



Lemma 2.3 



Let u,v be nonnegative functions in L 1 (IR) and let K,G be defined by 



K(t,r) 



u(0dH, G(t,r) 



w(0de, t,re 



Then %k Q %g if an d only if the set u(t) > 0, v(t) = 0} has Lebesgue measure zero and the 

essential bound A ofu/v on {t £l: v(t) > 0} is finite, in which case there holds 



Ha 



<VA||/|| 



Hk- 
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We are ready to present upper bound estimates for £ n {Rx)- 

Theorem 2.4 Let 5 < ir and suppose that the function p in \2.J$ belongs to L°°(\—5,8\). Then it 
holds for all n G N that 

£n(Rx) < iivpiIl~([-m])^ 2 +^- 5 ^= ex p (-^r^ n ) • (2 - 9) 

Proof: Note that K$ has the form 

Ks(t,r) = ^- [ jWZdt, t,r€R. (2.10) 
2vr J_ s 

By equation (|2.4p and the assumption that p G L°°([— (5, 5]), we get by Lemma [231 that "H_r x C 
and 

11/11^ < \/2^||VpIU-([-m)II/H«hx' / G 

It follows that 

U(H Rx ) c V^IIx/pIUcq^])^^). 
This inclusion relation together with (|2.5j) implies 

£n(Rx) < V2TT\\yfp\\ L ™([~5,8])£n{K5). 

Applying the upper bound estimate for £ n {K$) in Lemma E21 yields (12. 9j) . □ 

We shall use a different estimate method for the general case when the function p in (|2.4p only lies 
in L 1 ([—5,5]). For notational simplicity, we shall denote for each t G R by et the complex exponential 
function 

e t (£):=e^, £ £ R. 
Lemma 2.5 Le£ /? G 5, 5]) and Rx be of the form {2.1$ . It holds that 

1/2 

£ n (Rx) < \\p\\li([- S> s]) sup{dist i0 o ([ _ 5]5 ] ) (e t , span{ej : j G J n }) : t G (0, 1)}. (2.11) 
Proof: By the proof Proposition 12.11 

£ n {Rx) = sup<^ dist Wi? (Rx{t, ■), span{R x (j,-) : j G J n }) : t G (0, 1) L 



Direct computation also yields 

<&&H Rx (Rx(t,-), span {i?x(i, •) : j G J„}) = dist L 2 ([-5,5])(\/pet, span{^/pej : j G J n }), t G (0, 1). 
Noting that 

dist L 2 ([-5,,5])(\/pef, spaniy/pej : j G J n }) < IIpII/iq.^]) dist I/t x,([_^])(e t , span{e j : j G J n }), i G (0, 1) 
completes the proof. □ 

By Lemma [23| we shall estimate the distance of et, t G (0, 1) to spanje^ : j G J n } in L°°([— 5, 6]). 
This will be done by truncating an exact series. Set for each k G N and a G by Cq([— a, a]) the 
space of functions on R with continuous derivatives that are supported on [—a, a]. 
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Lemma 2.6 Set k £ N and let <j) £ Cq ([-it + 5, ir - 5]) with 4>(0) = 1. Then it holds for each t £ (0, 1) 

that 

et(e) = Ee J (e)sinc(t-j>(t-i), £e[-5,8\, (2.12) 

where the series converges absolutely for £ £ [— 5, 5]. 
Proof: We first note for t £ (0, 1) and \j\ > 2 that 

\4>(t~j)\ < ^U^\\ L i^ +s , v - Si) \t-j\- k . (2.13) 

Thus, for each t £ (0, 1) the series 

^ej-sinc (t - j)<f>(t - j) 

defines a function in L 2 ([— 5, 5]). Taking the inner product of an arbitrary / £ L 2 [(— 5, 5)] with this 
function gives 

^^/(j)sinc (t-j)Ht-j), 
which, by Lemma 4.1 in [T3], equals 

V2^f(t) = fj{t)W)dt. 
Therefore, it holds in L 2 ([-5, 5]) that 



e t = ^2 e i sinc (* ~ ~ j)- 

As a consequence, ()2. 12j) holds for almost every £ £ [—5,(5]. Since both sides are continuous on [— 6, 5] 
by equation (|2.13p . the identity holds for all £ £ [— <5, <5]. That the series on the right hand side 
converges absolutely for each £ also follows from (|2.13p . □ 

Let (j) be as described in the above lemma. Making use of the identity (|2.12p . we have 

dist L co([_ (5i( 5])(et, span{ej : j £ J n }) < | sinc (t - j)\\<f>(t - ie(0,l). (2.14) 

We shall choose <fi whose Fourier transform decays fast to zero at infinity. By (j2. 13j) . one tends to 
choose (f> with as much regularity as possible. However, as k increases, the L norm of might 
increase to infinity as well. The infimum of this crucial quantity is precisely estimated in |14| . 

Lemma 2.7 Set k £ N. It holds that 

inf{-^||#)|| L i (h ^_, ]): G C o fc ([-7r + <5,7r-5]), 0(0) = lj = J^^kl (2.15) 



With the above three lemmas, we are ready to establish an upper bound estimate of £ n (Rx) for 
the general case when p £ L 1 ([— 5, 5]). 
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Theorem 2.8 Set 5 < n. Let p G L 1 ([—6, 6]) and Rx be of the form {2.J$ . It holds that 

^n(flx) < \\PU H[ -8 A) ^^^ + ^Tt)^M-^nl n>—. (2.16) 

Proo/: Let <p G C^Q-vr + <5,vr - 5]) with <f>(0) = 1. By Lemmas EH and equation (|2"7Hj) . 

£ n (Rx) < sup ||p||li f r a5 n V I sine (t — i)||0(£ — j)\. 

Noticing (|2.13p . we get for each t G (0, 1) 

£ |sinc(t-i)||0(i-i)| < ^=||0W||x 1( [-. + ^]) E ^TT- 

Elementary analysis indicates that J2j^j n ^,^+1 attains its maximum on [0, 1] at t = or t = 1. 
Thus, for all i G (0, 1), 



E ij_ 7 -ifc+i — n k+i + 2 E '^Fn - n k+i + 2 / ^fc+T^ s = (~ + 



j^J„ j=n+l 

Combining the above three equations yields 



1 2, 1 

n k n K 



1 12 1 

£ n {Rx) < IIpII^^^-^II^IIlhi-^-^C- + 



We then take the infimum of the right hand side above with respect to all cj) G Cq([— it + 6, ir — 6]) 
with (fr(0) = 1. By Lemma 12.71 we have 



Recalling the Stirling forumula 



fcl<^f-) ^ t€N, (2.17) 
10 \e. 



we arrive at 

w,| ,|i/2 11^21 , 1,1^ 2fe 

If n > 4/(vr - 5), we let = to get 

c 1 t> \ / 11 11 1/2 He 2V2 ir-6 
£n{Rx) < \p\£ 1( , SS]) — 1 ={-z-7=- + — p==)exp — n , 

which yields (j2"7[6]) . □ 

The upper bound estimates (|2.9p and (|2.16p indicate that for 5 < ir, the intrinsic error £ n (Rx) of 
the optimal linear reconstruction from oversampling decays exponentially. We shall show that under 
a mild assumption on p, it can not decrease to zero at a rate faster than exponential decayness. To 
this end, we need the following well-known structure of the reproducing kernel Hilbert space of a 
translation-invariant reproducing kernel (see, for example, |21| . page 139). 
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Lemma 2.9 Let tp be a nonnegative function in L 1 (M) and K be the reproducing kernel defined by 

K(t,r):= [ e i( *" T) V(£R, i,r€R. 
Jr 

Then Hk consists of those functions f G C(M) whose Fourier transforms are contained in L 1 (M) and 
satisfy 

i t r i/(-oi 2 N 1/2 



"'^vsU^ir^ <+ °°- 

Theorem 2.10 Suppose that there exists [a,b] C [—5,5] suc/i i/iai 

K0>™, fe[a,&] 

/or some positive constant m. Let 5' := (b — a)/2. T/ien if holds for all n E N i/iai 

5^2^ 5' /o" ,x 2 " 



«?n(-Rx) > ^ - • (2.18) 

V 7 " lleV32n + l \4> 



Proof: Set 

By Lemma [2T3l %a' ^ %J?x an< ^ f° r an / e 



By similar arguments used in the proof of Theorem [2 

£ n (#) < -^SrARx). (2.19) 
V 27rm 

We then apply Lemma 12.91 to K and K$r to see that 

(T/)(f) := e-^V(i), t G R 
is a linear isomorphism from Hk to 'Ha'*/ • Since 

II?7IIl°=((o,i)) = ll/IU°°((o,i)) 

and {Tf){J n ) = if and only if f(J n ) = 0, we observe from A2.5H that 

£ n (K) =£„(A». (2.20) 
Combining (|2. 19j) , (|2.20p and the lower bound estimate for £ n (Kgi ) in Lemma 12.21 yields ()2. 18[) . □ 
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3 Practical Reconstruction with Exponentially Decaying Errors 

In this section, we present two practical reconstruction methods with exponentially decaying approx- 
imation errors for bandlimited random processes. We shall consider the modified Shannon series 
approach (jl.8p . In the first method, we shall use the multiplier proposed in |10j 

g m (t) := sine (t) sine m (^^-t), t G R, m G N 

nm 

and shall directly apply the following error estimate established therein. 

Lemma 3.1 There exists a positive constant C such that for all n > e/(ir — 5) and m = [n(7r — S)/e\ 

sup{|/(t)- f(j)g m (t-j)\: tG (0,1), f GU(B S )} < ° exp(-— n). (3.1) 
tl n(ir -5) e 

Our first reconstruction algorithm is explicitly defined by 

{AiX){t,u) := J2 X(j,uj)g m (t-j) 

where m= [n(ir — 5)/e\. The overall approximation error of A\ is measured by 

£ n (Ai) := sup{ || X(t,-) - (AiX)(t,-) \\ L 2 {n4PH y. t G (0,1), R x G U(B 5 )}. 
We show below that £ n (A\) decays exponentially to zero as n tends to infinity. 
Theorem 3.2 There exists a positive constant C such that for all n > max{e/(7r — 5), e 2 }, 



£n(A x ) < cJ-^—eM-^n). (3.2) 
y n{TT — 0) 2e 



Proof: We first compute by (|1.3p to get 

|| X(t,u) - (AxX)(t,u) Wl^dPiu)) 

= R X (0) -J2 R x(t- j)9rn(t ( Rx ti ~ *) _ J2 Rx ti ~ /C )^m(t " k)) 9m (t - j). 

jeJn j&Jn fcSJn 

Let R x G U(B S ). Then Rx(u - •) G U(B 5 ) for each u G R. We apply Lemma IXTl to R x (t - •) to get 
for n > e/(ir — 5) that 

sup{ | R x (0) - V Rx(t-j)g m (t-j) \:t G (0,1)} < — -exp( n). (3.3) 

k ^-^ 1 n(7T — o) e 



We then apply Lemma 1331 to each Rx(j — •) for j G Z to have 

^ < 

n(ir — 5) 



sup{ | Rx(j-t) - Rx(j -k)g m (t-k) |: t G (0,1)} < ^ _ ^ exp( n) 



Therefore, we attain for each t G (0, 1) that 

n(7r — a) e 



J2 (Rx(j-t)-J2 Rx(j-k)g m (t-k))g m (t-j) < _ exp( n) ^ | g m (t-j) \ . (3.4) 



j£Jn 
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Note that the sine function is uniformly bounded by 1. By this fact, when t G (0, 1) and n > e 2 , 

\9m(t-j)\ < |smc(t-i)| < C'lnn, (3.5) 

where C is a positive constant. Combining (|3.3[) . (|3.4p . and ()3.5[) completes the proof. □ 



One sees that the dominating exponential part in the estimate f)3.2|) degenerates compared to the 
estimate (|3.2p for deterministic signals. Through more careful analysis, we shall show that one is able 
to attain the same optimal order of exponential decayness for bandlimited random processes as for 
deterministic signals. Moreover, in order to present an explicit and practical reconstruction algorithm, 
we desire a function that achieves the infimum (12.15|) . 

It has been shown that there does not exist a function (j) G {[—tt + 5, it — S\) that attains the 
infimum (I2.15p . However, a spline function B k belonging to C^ k 2 \[— vr + 5, ir — 5]) that satisfies 



Wfll< ,„ (3.6) 



2 k ~ 1 k\ 

{■K-5) k \iY 

and 

/(*) = E sinc (< - fiMt - j), for all t G R and / G B s (3.7) 

jez 

is constructed in [23]. The spline function is determined by 



where 



J7T 

Xkj '■= cos — , < j < k 
k 

are the zeros of the first-kind Chebyshev polynomial of degree k on [—1,1], and a k j , < j < k are 
the unique nonnegative constants satisfying 

k 

J2(-l) k - j a kj x l kj = 0, < I < k - 1 

j=0 

and 

fe 

J^a fcj = V2^2 k - 1 k\. 

3=0 

Our second reconstruction algorithm is explicitly given by 

(A 2 X)(t,u) := X(J,uj) sine {t-j)B m ((t-j)) 

where m = [n(ir — 5)/2\. We shall need one last lemma to estimate the associated approximation 
error 

£ n (A 2 ) := sup{ || X(t,-) - (A 2 X)(t,-) h*(n, d p(u)y- 1 G (0,1), R x G U(B S )}. (3.8) 
Lemma 3.3 fM/ Let q>\ and l/p+l/q=l. It holds for all t el that 

^2 I sine (i - j) | 9 < p. 
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Theorem 3.4 For each n > max{2/(-7r — 5),e}, there holds 

t d \ 121 n/A i -,lnrt+ 1.1/4 / 7t — 5 , 

£n(A 2 ) < y —e 3 /V2 + vr - 5(^_) 1 /4 exp ( _ __ n ) . (3 . 9) 

Proo/: Let i?x G C^C^), iG (0, 1), and /i := sine fi m . We compute by (fL3|) that 

\\X(t,.)-(A 2 X)(t,-)\\ 2 LHn4P{uj)) 

= R X (Q) - E R x (t - j)h(t - j) - E {Rx(k-t)-Y,Rx(k-j)h(t-j))h(t-k). (3-10) 

Introduce 

:= R x (u - 1) - E Rx(u - j)h(t - j), «el 



Clearly, F G B$. By (I3T)) . 

| - E F ( k )H u ~ k ) | = | F ( k )K u ~ k ) l> 

Letting u = i in the above equations yields from (|3.10p that 

||X(t,0-(^2X)(t ) -)|li 2(n , d P H )= E {Rx(k-t)-J2Rx(k-j)h(t-j))h(t-k). 

Since - •) G U(B S ) for each e Z, we get by (f37T)) 

||X(t,o;)-(^l 2 X)(t,a;)||| 2(n)dP(a;)) = | E ( E " " ■?')) ^ " fc ) ' • 

We then choose 7 G (1/2, 1) and apply the Cauchy-Schwarz inequality twice to attain 

1 J2 (J2Rx(k-j)h(t-j))h(t-k) 1 2 

i r 1 r i 3 - 12 

X)(E \Rx(k-j)^(t-j)\ 2 ) Yl I sinc^-j^-i)! 2 ^|M^-fc)| 2 



< 



It remains to estimate the three sums above. First, since Rx(- — j) £ U(B$) C U(B n ), by (|2.3p 

E I R x(k-j) | 2 = / I Rx(u-j) \ 2 du= \\Rx\\ 2 Bn < 1, j€Z. (3.13) 

By (|3.13p and Lemma |3.3[ we get by exchanging the order of summation that 

E ( E I ^ - •?') sinc7 (* - i) I 2 ) < E I sinc^(t-i) |< (3.14) 
Next, it follows from (13.61) that 



i - 2 m - 1 ml \ 2 1 , 

E I smc ^(t - j)B m (t - j) | 2 < -t-t—T^ E 77— ^Tm^) - ^ 



^vr 1 -^ (vr - 5) m J (t - j)2m+2(l-y) 
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Again, by (|3.6|) . 

, , / n,2 H 2 m - 1 m! \ 2 1 . 

D 1 ^ - fc) 1 ^ U (^fJ e ttw^- (3 - 16) 

Combining (f3TTTT) . (f3TT2l) . (pHll) . (fBTToD . and (f3TT6l) yields 

^37 J ^(t^TTT^J snp{yM^:tG(0,l)}, (3.17) 

where 

^):=E^-p^. ^(0,1), 

and 

By a similar estimate technique as that in the proof of Theorem 12. 8| 

/ \ 1 \ — ^ ^ 1 \ / \ 

1W ^ n 2m+2-2 7 + 2^ ? -2m+2-27 - n 2m+l-2 7 (~ + ~ 7 1 _ )' * € (°' V' 
j=n+l " 2 * 

which combined with the Stirling formula (|2.17p gives 

2 m " 1 m! r , — — . ., lly 7 ^ 27-1 /m m / 2m \ m 

supi^/Mt) : i G (0,1)} < — ^— n— ./- + I- — . (3.18) 



(vr - 5) m v > ;j - 20 y n m + i _ 7 _ j) en 

swise, 

1 2 m - 1 m\ . r—r . , llv 7 ^ /m ~Y 2m 



supiv^: t€(0,l)} < ^5= ^TlC 2m \ m _ (g 1Q) 

20v7rn y n \{ir — d)en J 



vr 2 "'/ (vr - S) 1 
We observe from (I3TT7D . (IBTTSj) . and (pM) 

2 7 2 \5 121 1/m \ / 2m N 2 "' 



{£n{A,)f<[-^-n^\ -^=- - + 1 



27 - 1 / 100\/2 n V n J V (tt - 5)en 

We optimize the right hand side above with respect to 7 to choose 7 = ^(1 + j^) when n > e. With 
this choice, 



100V2V n \n yV(7r-^)eny 



For n > max{2/(7r — S),e}, we substitute m = [n(-K — 5)/2\ into the right hand side above to obtain 
(|3.9p and completes the proof. □ 



We remark that estimate (I3.9P has the same order of exponential decayness as that obtained in 
for bandlimited deterministic signals. 
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